Edge-distributed fusion of camera-LiDAR for robust moving object localization
نویسندگان
چکیده
Object localization plays a crucial role in computational perception, enabling applications ranging from surveillance to autonomous navigation. This can be leveraged by fusing data cameras and LiDARs (Light Detection Ranging). However, there are challenges employing current fusion methods edge devices, while keeping the process flexible modular. paper presents method for multiple object that fuses LiDAR camera with low-latency, flexibility scalability. Data is obtained 360° surround view four scanning distributed over embedded devices. The proposed technique (a) discriminates dynamic objects scene raw point clouds, clusters their respective points obtain compact representation 3D space (b) asynchronously fuse centroids detection neural networks each detection, localization, tracking. meets above functionalities low-latency increased field of safer navigation, even intermittent flow labels bounding boxes models. That makes our system distributed, modular, scalable agnostic model, distinguishing it state-of-art. Finally, implemented validated both indoor environment publicly available outdoor KITTI 360 set. occurs much faster accurate when compared traditional non-data driven latency competitive other non-embedded deep learning methods. mean error estimated ≈ 5 cm precision 2 navigation 15 m (error percentage 0.3%). Similarly, 30 3 35 on set 0.8%).
منابع مشابه
Robust depth-based object tracking from a moving binocular camera
Depth is a rich source of information and has been successfully utilized in numerous computer vision applications. However, it is often ignored in object tracking. In this paper, in contrast to traditional 2D image-based tracking method, we propose a novel 3D object tracking method from a moving binocular camera. To effectively handle the deformable targets, a target is first represented by a l...
متن کاملRobust Moving Object Detection from a Moving Video Camera Using Neural Network and Kalman Filter
Detecting motion of objects in images, while the camera is moving, is a complicated task. In this paper, we propose a novel method to effectively solve this problem by using Neural Networks and Kalman Filter. This technique uses movement parameters of camera to overcome problems caused by error in image processing outputs. We implemented this technique in the MRL Middle Size Soccer Robots. Expe...
متن کاملFusion of 3D-LIDAR and camera data for scene parsing
Fusion of information gathered from multiple sources is essential to build a comprehensive situation picture for autonomous ground vehicles. In this paper, an approach which performs scene parsing and data fusion for a 3DLIDAR scanner (Velodyne HDL-64E) and a video camera is described. First of all, a geometry segmentation algorithm is proposed for detection of obstacles and ground areas from d...
متن کاملDistributed Localization of Camera Networks
Motivated by applications in ad-hoc camera networks, we present distributed algorithms for the automatic, external, consistent, metric calibration of a network of cameras distributed over a large geographical area with no centralized processor. First, we model the set of uncalibrated cameras as nodes in a communication network, and propose a distributed algorithm in which each camera only commu...
متن کاملFixed-Camera Visual Servoing of Moving Object
Visual servo control of robots has been recently considered and developed by many researchers. In this paper we have used a fixed camera for obtaining location and orientation of a moving object on a conveyor belt and then tracking the object. Tracking trajectory is obtained using a new event-based real-time path generation. Using the error signal obtained, which is difference between location ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2023
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2023.3295212